Papers with static and contextualized distributional models
Comparing Static and Contextual Distributional Semantic Models on Intrinsic Tasks: An Evaluation on Mandarin Chinese Datasets (2024.lrec-main)
Copied to clipboard
| Challenge: | Distributional Semantics has undergone significant changes with the introduction of contextualized distributional models. |
| Approach: | They compare static and contextual distributional models for Mandarin Chinese . they find that static models are stronger for some of the classical tasks . |
| Outcome: | The proposed models perform better on some of the classical tasks that consider word meaning independent of context, while contextualized models excel in identifying semantic relations between word pairs and categorization of words into abstract semantic classes. |